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(54) A telephone system integrating a public switched telephone network, a packet-switched 
network and a call answering system* 

(57) The present invention is directed to a system 
that allows a subscriber to take a telephone call over the 
Internet when the subscriber telephone line is busy 
servicing a browser-based Internet session without 
requiring that the subscriber disconnect or terminate the 
Internet session. The system transfers a telephone call 
to a subscriber telephone line that is busy to a call serv- 
icing platform where the platform determines if the sub- 
scriber line is busy due to an interactive Internet 
session. When a session is in progress, the platform 
informs the subscriber via a network message to the 
subscriber's personal computer involved in the session 
that a call is waiting. If the subscriber accepts the call, 
the platform digitizes the speech of the caller and sends 
it to the computer where it is output to the subscriber. At 
the same time, the computer digitizes the speech of the 
subscriber and sends it to the platform, where it is out- 
put to the caller. The system can also allow the sub- 
scriber to screen the caller by listening to the caller as a 
message is recorded. The network session can con- 
tinue during the transfer of the speech or resume after 
the call is finished, that is, the session need not be ter- 
minated to free the telephone line to carry the call. 




FIG. I 
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Description 

The present invention is directed to the field of 
packet-switched network telephony and, more particu- 
larly, to a system that allows a network user using a net- 
work, such as the Internet, to receive a telephone call 
through a call answering system while interacting with 
the network without disconnecting from the network, 
thereby integrating local telephone service with the 
Internet using the call answering system. 

Many people access the Internet from their home 
using a 14.4 or 28.8Kbps modem over their single resi- 
dential phone line. When a subscriber is using the Inter- 
net, they are "tying up" their phone line, and are 
therefore unable to receive telephone calls from the 
public switched telephone network (PSTN), i.e. their line 
is "busy". With the advent of "Enhanced Services", res- 
idential customers can subscribe to "Call Answering" 
where a subscriber can rent a mailbox from a service 
provider and have the local telephone company forward 
busy and ring-no-answer calls to the subscriber's mail- 
box. For example, when a subscriber is using the Inter- 
net, and the telephone line is busy, the mailbox is used 
to record and save messages. While this is better than 
giving the caller a busy signal, it requires that the sub- 
scriber log off of their on-line service in order to access 
their mailbox to check if they have a message. 

What is needed is a system that allows the sub- 
scriber to receive an indication on their PC that a call is 
waiting, and allows the subscriber to answer the call and 
speak to the calling party without disconnecting from 
the network session. 

This application is related to EP Application No. 
97308910.5 and US Patents 5,029,199, 5,193,1 10 and 
5,493,607 all incorporated by reference herein. 

In accordance with one aspect of the present inven- 
tion, a system comprises: 

a packet-switched network; 

a computer coupled to and conducting a session 

with said network over a telephone line; 

a telephone system transferring a telephone call 

away from the telephone line with the telephone line 

is busy; and 

a call servicing system coupled to said telephone 
system and said network, accepting the transferred 
call and establishing a communication link with said 
computer over said network with the link carrying 
the call. 

The present invention provides a system that allows 
a subscriber to take a telephone call or, at the sub- 
scriber's discretion, direct the call to a mailbox, all with- 
out disconnecting from the Internet. 

The present invention can also provide a system in 
which a telephone subscriber does not need multiple 
telephone lines from the PSTN to speak to calling par- 
ties while the subscriber uses the on-line service, 



thereby providing a significant cost saving to the sub- 
scriber. 

The present invention provides a system that works 
with hardware that is commonly available and deployed 
5 today, and that does not require the subscriber to obtain 
special equipment, such as a simultaneous voice and 
data modem. 

The present invention allows a subscriber who has 
a system by which they access the Internet to use this 
10 system to answer a telephone call. 

The present invention integrates the Internet with 
call-answering and local telephone service. It can also 
allow the subscriber to screen calls by instructing the 
system to take a message from the caller and allow the 
15 subscriber to listen to the message over the network as 
it is recorded. 

The present invention may provide a system that 
will record facsimile messages and provide them to the 
subscriber while the subscriber is involved in a network 
so session. 

A subscriber can in some cases receive a call over 
the network even when the subscriber is not using their 
residential telephone line and is away from home. 

In some aspects, the present invention performs 
25 echo cancellation of echoes provides by PSTN circuits, 
and does not transfer speech packets when a party is 
silent. 

The system typically allows a subscriber to take a 
telephone call over a packet-switched network when the 

30 subscriber telephone line is busy servicing a network 
session, such as a browser-based Internet session, or 
the subscriber is away from home and involved in a net- 
work session. The system transfers an incoming tele- 
phone call from a subscriber telephone line that is busy 

35 (or on which a ring-no-answer occurs) to a call servicing 
platform. The platform determines if the subscriber line 
is busy due to an interactive network session or if there 
is no answer because the subscriber is engaged in a 
network session at another location. In either case, if 

40 such a session is in progress, the platform informs the 
subscriber via a network message to the subscriber's 
computer involved in the session that a call is waiting. If 
the subscriber accepts the call, the platform digitizes the 
speech of the caller and sends it to the computer where 

45 it is output to the subscriber, and the computer digitizes 
the speech of the subscriber and sends it to the platform 
where it is output to the caller. If the subscriber chooses 
to screen the call, the caller is allowed to record a mes- 
sage and the message is provided to the subscriber 

so over the network as the message is recorded. If the call 
is a facsimile call, the platform saves the facsimile mes- 
sage and the subscriber can retrieve the facsimile mes- 
sage over the network during the network session. The 
network session can continue during the transfer of the 

55 speech packets, so that the subscriber need not termi- 
nate the network session to speak to the caller. 

These together with other aspects and advantages 
which will be subsequently apparent, reside in the 
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details of construction and operation as more fully here- 
inafter described and claimed, reference being had to 
the accompanying drawings forming a part hereof, 
wherein like numerals refer to like parts throughout. 

Figure 1 depicts an integrated system according to 
the present invention; 

Figure 2 illustrates the components of the platform 
22 of figure 1 ; 

Figures 3 and 4 illustrate the process performed by 
the PC 1 0 of figure 1 ; and 

Figures 5 and 6 illustrate the process performed by 
the platform 22 of figure 2. 

The present invention allows a person using a 
packet-switched network, such as the Internet, to take a 
telephone call using their computer without disconnect- 
ing from the network. To help in understanding the 
invention, it is useful to describe the basic call flow of a 
typical end-to-end call. 

In a typical situation, a subscriber uses a PC 10 to 
access a packet-switched network 1 2, such as the Inter- 
net, by requesting that a modem 14 dial the access 
number for an Internet Service Provider (ISP) 16. The 
modem 1 4 uses a loop-start analog line connected to 
the local public switched telephone network (PSTN) 18 
to dial a second modem 20 connected to the ISP 16. 
The PC 10 then uses a Serial Line Internet Protocol 
driver (SLIP or PPP) to convert Internet Protocol (IP) 
packets for transmission over the modem serial connec- 
tion between the PC 10 and the ISP 16. The ISP 16 
routes IP packets received from the subscriber's PC 10 
to the network 12, and routes packets from the network 
12 to the subscriber's PC 10 via the modem connection. 
Preferably, the local PSTN 1 8 and the ISP 1 6 are owned 
by the same company, so that the subscriber will not be 
faced with multiple bills for the same set of integrated 
transactions, although the ISP 16 can be that of a com- 
pany different from the local telephone service provider. 

Once the subscriber is connected to the network 
12, a software application or process on the sub- 
scriber's PC 10 registers the IP address of the client PC 
10 with the platform 22 via the network 12 by sending a 
message (a "registration" packet) with the IP address of 
the PC 1 0 to the platform 22. The platform 22 stores this 
information in the subscriber database associated with 
this subscrtoer. The subscriber database stores, among 
other items, the subscriber's telephone number, i.e. the 
number of the telephone line whose busy, or no-answer, 
calls are to be handled by the platform 22. This tele- 
phone number is referred to as having been "provi- 
sioned" on the platform 22. The registration process 
associates the subscriber's PC IP address with the pro- 
visioned telephone number. Security and encryption 
mechanisms (such as available from RSA) are prefera- 
bly used to ensure that the subscriber's PC 1 0 is the PC 
registered to control the provisioned telephone number 
(so that "hackers" cannot usurp phone calls intended for 
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other parties). 

Once the address registration is completed, the 
subscriber typically interacts with the network 12 using 
a conventional interface, such as a browser. While the 

5 subscriber is on-line with the ISP 16, the subscriber's 
PSTN phone line is busy At some point, a calling party 
24 wishes to speak to the subscriber, so the calling 
party 24 dials the telephone number for the subscriber. 
In this situation, a PSTN end office (not shown) forwards 

10 busy calls intended for the subscriber's telephone 
number to the platform 22 via a multi-line hunt group 
connection that the platform 22 has with the PSTN 18. 
When the can arrives, the platform 22 examines auto- 
matic number identification (ANI) information associ- 

is ated with the incoming call (using a SMDI, SS7, ISDN or 
DID protocol) and compares the called party number 
with the subscriber database to ascertain which sub- 
scriber is being called or attempted. The platform 22 
also looks in the subscriber database record for the 

20 called subscriber to determine if an IP address is cur- 
rently associated with the subscriber's telephone 
number. Since the subscriber is on-line and the registra- 
tion process has been completed, there is an IP 
address associated with the subscriber, so the platform 

25 22 initiates a conventional TCP/IP session with the soft- 
ware process running on the subscriber's PC 10 and 
sends a call-waiting notification to the process on the 
PC 10. The dient software running on the subscriber's 
PC 10 notifies the subscriber that a call has arrived 

30 using, for example, a pop-up window, and optionally 
gives the subscriber the calling party information that 
was supplied by the PSTN 18 to the platform 22 to allow 
the subscriber to screen calls. 

In the meantime, the calling party 24 is receiving a 

35 ring-back signal, although a different signal can be 
played, so that the calling party does not know that the 
subscriber's line is busy. The device that provides the 
ring-back signal to the calling party depends on the type 
of signalling interface that is used to connect the plat- 

40 form 22 to the PSTN 18. If the platform is connected as 
"line side" equipment, the end or central office provides 
the ring-back signal until the platform 22 answers the 
call. When the platform has answered the call or in a 
DID environment ("trunk side"), the platform provides 

45 the ring-back signal. For simplicity of discussion herein 
the description simply refers to a ring-back signal being 
provided to the caller. 

When the subscriber chooses to answer the call, a 
notification message (an "accept" call packet) is sent 

so back to the platform 22 via the network 1 2 indicating this 
fact The platform 22 then answers the incoming call 
from the calling party 24 via the PSTN 18. At this point, 
the platform 22 digitizes the calling party's speech sig- 
nal and transmits it via User Datagram Protocol 

55 (UDP/IP) packets to the subscriber's PC 10. The plat- 
form 22 accepts UDP/IP speech packets via the net- 
work 12 from the subscriber's PC 10 and plays them to 
the calling party 24 through the telephone. A similar 
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process occurs at the same time on the subscriber's PC 
10, where software and hardware on the subscriber's 
PC 10 digitizes speech from a PC microphone and 
sends the digitized speech via UDP/IP packets to the 
platform 22 and accepts UDP/IP speech packets from 
the platform 22 and plays them over the PC 10 speaker 
to the subscriber. 

If the calling party hangs up, signaling information is 
sent via the PSTN 18 to the platform 22 indicating this 
fact. The platform 22 then notifies the software running 
on the subscriber's PC 10 via the network 12 that the 
calling party has disconnected. At this time, call event 
records can be generated on the platform 22 for billing 
purposes. 

As an additional feature, the subscriber can config- 
ure the platform 22, via the PC 10 over the network 12, 
to notify the subscriber of calls arriving from only partic- 
ular calling parties by creating or updating a list of num- 
bers and corresponding people maintained in the 
subscriber database for the subscriber for this purpose. 
In this case, the platform 22 examines the calling party 
telephone number supplied by the PSTN 18. If the call- 
ing party telephone number matches a number on the 
list defined by the subscriber, then the platform 22 initi- 
ates the call as described above. If, however, the calling 
party number does not match (or if no calling party infor- 
mation was supplied), then the platform 22 can either 
provide a busy signal back to the calling party or the 
platform can immediately answer the call and take a 
voice or facsimile message, as the platform 22 does 
conventionally in a call answering application. 

Note that the subscriber's telephone line need not 
necessarily be in use to have calls redirected to the PC 
10. For example, if the subscriber is away from home 
and has access to the network 12 via an ISP, then the 
subscriber can notify the platform 22 to direct calls via 
the network 12 to the subscriber's PC 10 wherever the 
subscriber happens to be at that time. In this case, the 
PSTN 18 must be configured to forward either all calls to 
the platform 22, or to forward ring-no-answer calls to the 
platform 22, based on the subscriber's preferences. 

Finally, the call to the platform 22 need not arrive via 
the PSTN 18 shown in figure 1. Instead, the call could 
also have originated via the digital IP network 12. In this 
case, the "originating" platform 26 communicates with 
the subscriber's "home" platform 22 to determine if the 
subscriber is currently accepting calls via the PC 10, 
and if so the subscriber s IP address is provided to the 
originating platform 26 and the originating platform 26 
plays the role of platform 22 in figure 1 . The originating 
platform 26 plays the role of the platform 22 in this situ- 
ation because the caller is connected to that originating 
platform 26. The originating platform 26 could be 
another PC 28. In either case, the platform 22 is no 
longer involved as it is only used to obtain the sub- 
scriber's IP address. The originating platform 26 com- 
municates directly to the PC 10 using the IP address 
associated with the subscriber on platform 22. In this sit- 



uation, if the subscriber declines the call, the originating 
platform 26 records a message for the subscriber. The 
originating platform 26 then sends the message via the 
network 12 to the subscriber's "home" platform 22, 

5 where it is stored. 

The PC 10 depicted in figure 1 is preferably a con- 
ventional multimedia Pentium™ class personal compu- 
ter having a full-duplex sound card, speakers, a 
microphone, a modem with preferably a speed of at 

10 least 28Kbps to allow the sending and receiving of 
speech data in "real-time" and an operating system 
such as Windows95™. The software running on the PC 
for the present invention is typically a client PC applica- 
tion or process that executes in "parallel" with the 

is browser. However, the PC 10 could include a conven- 
tional Internet browser, such as Netscape Navigator™ 
or Microsoft Internet Explorer™, that allows "plug-in" 
applications to be automatically initiated while the user 
is browsing sites on the network 12 with the client PC 

20 application running as a plug-in. The PC 10 also 
includes a conventional Internet telephony/voice pack- 
age, such as TrueSpeech, that performs speech signal 
compression and decompression. The client PC proc- 
ess, as well as the browser, can be provided to the sub- 

25 scriber via a floppy disk or downloaded via the network 
12 for storage on the hard disk medium of the PC 10 
when the subscriber signs up or registers for service 
over the network 12. 

The platform 22 preferably has an architecture, as 

30 illustrated in figure 2, that is based on the distributed 
voice mail platform described in U.S. patent 5,029,199. 
The platform 22 includes a control unit (CU) 30 which 
communicates with the PSTN 18 for telephone call con- 
trol and routing. An incoming call is routed through a 

35 digital switch 32 to form a connection between an appli- 
cation processing unit (APU) 34, which performs the call 
processing of the platform 22, and the PSTN 18. The 
digital switch 32 and the routing control by the CU 30 
are not required when ports of the APU 34 are dedi- 

40 cated to the telephony operation of the invention and a 
central office switch is provided within the PSTN 18 that 
hunts for an available trunk to the dedicated APU 34. 
The digitized speech packets of the caller 24 can be 
transferred between the APU 34 and a network 

45 processing unit (NPU) 36 over an internal ethernet 38. 
The system also can include a high speed 100 Mbps 
ethernet connection 40 directly between the APU 34 
and NPU 36. The NPU 36 is essentially a conventional 
IP router, such as available from Cisco Systems or Bay 

so Networks, through which the digital speech packets are 
routed to the PC 10. Each of the units 30 and 34 is 
based on a personal computer, such as an Intel Pen- 
tium™ 133/166 MHz processor with 32M RAM, 4GB 
mirrored/redundant disk drives running the Microsoft 

55 WindowsNT™ operating system and coupled together 
by the 10Mb ethernet 38. such as found in the 
AccessNP™ system available from Boston Technology 
Inc. The processes of the present invention are typically 
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stored on disk drives and loaded into RAM for execution 
as needed. The units also include appropriate conven- 
tional interface units, such as voice modules from Natu- 
- ral Microsystems including a high speed digital signal 
processor (DSP), necessary to perform the interlace 
function of that particular unit. It is also possible for the 
NPU 36 to be configured with the voice logic circuits 
necessary for the NPU 36 to also perform the functions 
of the APU 34. That is, a single processor can handle 
the interface and routing functions. 

Although not shown in figure 2, the APU 34 prefer- 
ably includes echo cancellation technology such as that 
available from Coherent Communications, located on 
the PSTN "side" of the platform 22 to cancel echoes that 
are produced in the 2-to-4-wire hybrid circuits of the 
PSTN 18. Because of the delay associated with the 
packet-switched network 12, the echo is noticeable and 
annoying to the subscriber at PC 10 and is preferably 
cancelled. 

During a typical incoming telephone call to a plat- 
form, such as platform 22, the CU 30 of the platform 
uses the telephone number dialed by the calling party to 
control the switch 32 to route the call from the incoming 
trunk to an available voice port of an APU 34 that 
includes a network telephony application. The CU 30 
also informs the particular APU 34 assigned the call that 
the call is arriving on the available port. 

The network telephony application of the APU 34 
interacts with the calling party using a conventional 
process to cause a ringing signal to be provided to the 
caller while the PC 10 is being queried. While the ring- 
ing signal is being played, the APU 34 accesses a sub- 
scriber database, typically maintained by the CU 30, to 
obtain the IP address of the PC 10. If the subscriber 
database stores no IP address, the APU 34 performs 
conventional operations to allow the caller 24 to leave a 
message for the subscriber. 

On the other hand, if the database stores an IP 
address, the IP address is used by the APU 34 to form 
a packet to be sent to the PC 10. The packet includes a 
message or notification indicating that a call is waiting 
as well as the AN I information of the caller. This "call 
waiting packet" is provided to the NPU 36, which routes 
it to the PC 10. When the PC 10 responds with a mes- 
sage accepting the call, the APU 34 establishes a vir- 
tual connection over the Internet 16 to the PC 10. Once 
the PC 10 has accepted the call and a connection has 
been established, the APU 34 samples the incoming 
speech of the calling party and compresses the speech 
using a compression procedure, such as the low bit rate 
procedure available from DSP Group known as 
TrueSpeech/G.723 and which is typically used for the 
audio portion during video conferencing (See 
www.dspg.com for detailed information about this tech- 
nology). Of course other compression algorithms, such 
as u-law or A-law (G.711) can be used. The APU 34 
then sends speech segment sample UDP packets over 
the internal ethernet 40 through the NPU 36 to the PC 
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10. The APU 34 also performs conventional call moni- 
toring operations on the caller's trunk looking, for exam- 
ple, for a dial tone indicating that the caller has hung-up. 
The processes discussed below with respect to the 

5 present invention are described for convenience using 
flow charts that depict the operations as flowing from 
one operation to another. However, the processes are 
preferably implemented as interrupt driven processes. 
For example, during a conversation, the PC 10 digitizes 

w the speech of the subscriber and sends it to the platform 
22 to be played to the caller, and when the subscriber 
"clicks" on a window button to hang-up, this click is 
detected by an interrupt manager that then executes the 
hang-up process. 

is The PC 10, as previously mentioned establishes a 
connection 50 to the ISP 16 as depicted in figure 3. 
Once the connection is established, the PC 10, using 
the platform IP address (PIP) of the subscriber's home 
platform 22, transmits 52 an "on-line" command or "noti- 
ce fication" packet to the platform 22 that includes the IP 
address and port number (PCIPPN) of the PC 10. This 
occurs in the following manner. 

The client PC software or process, which is config- 
ured to execute each time the PC 10 starts a network 

25 session, requests a TCP port from the operating sys- 
tem, such as Wmdows95™. The process also requests 
from the operating system the IP address of the PC 1 0. 
It should be noted that this IP address can change for 
each network session that the subscriber invokes. 

30 Using the configuration information that was previously 
entered into the PC 10 by a sign-on process or by the 
subscriber, the client PC process "registers** with the cli- 
ent's (subscriber's) platform 22. The client's platform 22 
is known by a specific machine name, such as 

35 "anp12.bostech.com." The client process uses the 
Domain Name Service (DNS) of the ISP 16 to translate 
the machine name of the platform 22 to its IP address. 
The client process then connects (via TCP/IP) to the IP 
address returned by DNS, at a particular TCP port 

40 number (PN). The port number is "hard coded" to refer 
to a particular service or application and in this case the 
service may be called "Internet Call Waiting Registra- 
tion Service" using the IP address and port number 
(PIPPN) of the platform. For example, the "http" service 

45 is (by default) at TCP port "80." After connecting to the 
platform 22, the client process sends a packet to the 
platform. This packet includes the following information: 
the subscriber's telephone number, the appropriate 
security code for authentication of the subscriber, the IP 

so address of the PC 10, and the TCP port number (PN) 
that the PC operating system provided to the client 
process. The platform stores this IP address and port 
number (PCIPPN) in the subscriber's database record 
(see 102 of figure 5) using the subscriber's telephone 

55 number. 

The PC 10 then "returns" to the normal browser 
process where the subscriber uses the browser to 
access various sites on the Internet through the ISP 16. 
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During this period, each time an IP packet arrives, it is 
routed 54 to the appropriate process based on the IP 
address and port number (PCIPPN). When the packet 
is not a "call-waiting" packet (or a TCP connect** 
packet), the packet is provided to the browser process 
and the browser process continues 56. When the user 
has finished browsing and a disconnect interrupt is 
detected, the PC 10 sends an "off-line" command 
packet to the platform 22 that includes the PCIPPN, 
which causes the platform 22 to delete the PCIPPN 
from the subscriber's database record (see 126 of figure 
4). 

When the packet is a "TCP connect" packet from 
the platform 22 the client PC process responds with a 
"TCP accept" packet. The client process then waits for a 
"call waiting" packet. 

When the packet is the "call waiting" packet which 
includes the UDP port number (UPN) of the platform, 
the client PC process of the present invention receives 
the packet and "pops-up" 62 a window on the PC 10 that 
informs the subscriber that a call is waiting and provides 
information, such as the caller ID of the caller, etc. K the 
caller's name and ID are in a caller database on the PC 
10, the caller's name can also be displayed. The win- 
dow preferably includes a button that allows the sub- 
scriber to accept or reject (decline) the call. The window 
also preferably includes a button that allows the sub- 
scriber to "screen" the call. 

If the user selects the "decline" option, the PC 10 
sends 66 a "decline" command or notification packet to 
the platform 22 (APU 34), which then performs a con- 
ventional ring-no-answer process that allows the caller 
to record a message (see 110 of figure 5). 

If the subscriber accepts 62 the call, the PC 10 
obtains a UDP port number (UPN) from the operating 
system, sends 68 an "accept" command packet to the 
PIPUPN of platform 22 (APU 34) that includes the UDP 
port number, so that the APU 34 can respond with 
speech packets to the PCIPUPN. The PC then begins 
70 digitizing the speech of the subscriber, sending 
speech packets to the platform 22 using the PIPUPN as 
a destination address, accepting speech packets of the 
caller's speech from the platform 22 addressed to the 
PCIPUPN and playing those packets to the subscriber. 

If the subscriber selects 80 the "screen" option (see 
figure 4), the PC 10 sends 82 a "screen" command 
packet to the platform 22 at the PIPUPN. The APU 34 of 
platform 22 immediately begins recording and saving a 
message as though the subscriber had declined the 
call. The APU 34 also copies the speech segments, cre- 
ates speech packets from the copy, and transmits the 
packets to the PC 10 using the PCIPUPN as the desti- 
nation address. The PC 1 0 performs 84 the receive and 
play operations of the talking phase previously dis- 
cussed, thus allowing the subscriber to listen to the 
message as it is recorded, but without the caller know- 
ing that the message is being heard by the subscriber 
as it is being recorded. The record and transmit opera- 



tions of the talk phase are not performed by the PC 10, 
resulting in no speech packets being sent by the PC 10 
to the platform 22. In this process the APU 34 stores 
speech segments on the message storage disk at the 

5 same time that the segments are transmitted to the PC 
10. The subscriber can listen to the message long 
enough to choose whether to accept the call. The sub- 
scriber can then decline the call, which will continue the 
recording but disconnect the call being transferred to 

w the PC 10. Alternatively, the subscriber can accept 64 
the call and the operations (70) previously discussed 
that establish the bi-directional connection and allow 
two way speech packets to be transmitted are per- 
formed, the recording process is terminated and the 

75 recorded message is discarded. 

During a period of UDP packet exchange between 
the PC 10 and platform 22, each side sends each UDP 
packet with a monotonically increasing packet 
sequence number. The receiving side discards any 

20 packet that arrives with a sequence number that is less 
than or equal to the packet sequence number of the 
packet that is currently playing (or has completed play- 
ing). 

The platform 22 and PC 10 also preferably perform 

25 a silence detection operation and do not send speech 
packets when the parties are not speaking, thereby con- 
serving network resources. In this situation, the other 
side does not receive speech packets during a silent 
period and "plays" silence to the party. The silence 

30 detection operation preferably has a very short silence- 
to-energy detection threshold period (<5ms) to insure 
that all the speech of the parties is captured and there is 
little or no speech clipping. The operation preferably has 
a relatively long energy-to-silence detection threshold 

35 period (>500ms). By meeting these criteria, computing 
resources are not wasted flipping back and forth 
between energy/silence. 

During the period (70) of speech packet exchange 
(see figure 3), the network session can be stopped by 

40 the user, can be put in a wait state by the user or can 
continue using the multi-processing capabilities of 
Windows95™, which is depicted by the bi-directional 
dashed line between the browser 56 and talk 70 steps. 
That is, in a session continuation situation, if the net- 

45 work session is updating/sending a page to the PC 10, 
the session can continue running in a main window of 
the PC 10 while the caller and the subscriber talk. In this 
situation, to facilitate the processing of the speech, the 
speech digitization and transmission operations of the 

so PC 1 0 are preferably given a higher priority than the net- 
work session processing, and the processing of the 
speech packets received by the PC 10 is preferably 
given a higher priority than the processing of the net- 
work session packets. To allow the session to continue 

55 while the caller and the subscriber are talking, prefera- 
bly a high speed network connection using a 56Kbps 
modem or an ISDN line is used. It is also possible to pri- 
oritize processing and reserve bandwidth by using 



6 



3NSDOCID: <EP 085698 1A2J_> 



11 

some of the more recently proposed IP protocols, such 
as RSVR 

If the PC 10 determines that a hang-up 72 (see fig- 
ure 3) has been initiated, by receiving a "hang-up" com- 
mand packet from the platform 22 or the user activates 
a hang-up button in the window, the PC 10 stops 74 dig- 
itizing the subscriber's speech, stops transmitting 
speech packets to the platform 22 and stops playing 
speech packets received from the platform 22. The PC 
1 0 then sends 76 an "acknowledge" or disconnect com- 
mand packet to the platform 22 and resumes the brows- 
ing process 56. 

In the platform 22, as depicted in figure 5, when an 
"on-line" packet is received 100, the IP address 
(PCIPPN) is stored 102 in the subscriber's database 
record, and the platform awaits a call arrival 104 from 
the caller 24. When a call is transferred to the platform 
22 by the central office switch of the PSTN 18, and the 
APU 34 answers the call, a ringing signal is played 106 
to the caller, and the APU 34 examines 108 the sub- 
scriber database record to determine if there is an 
PCIPPN (IP address and TCP port number) stored for 
the subscriber. If not, a conventional ring-no-answer 
process is performed 110 by the APU 34 to allow the 
caller to leave a message for the subscriber 

If a PCIPPN is available for the subscriber, the APU 
34 starts a timer and sends a TCP connect" packet to 
the PCIPPN. When a "TCP accept" packet arrives from 
the PC, the APU 34 of the platform 22 then sends 112 a 
"call waiting" packet (in TCP format) to the PC 10 using 
the PCIPPN. The call waiting packet includes the IP 
address and the UDP port number (PIPUPN) of the 
application or process servicing the caller 24. 

If after a short interval a response is not received 
from the PC 10 to the TCP connect" packet, the plat- 
form 22 can send another TCP connect" packet and 
continue to send them several more times. If after sev- 
eral such transmissions, there is no connect accept 
(TCP accept") response from the client PC process, 
then the platform 22 (APU 34) assumes that the sub- 
scriber has disconnected from the network and the plat- 
form 22 removes the PCIPPN from the subscriber 
database. The call is then processed 110 conventionally 
to, for example, take a message. 

After the TCP connect, the platform 22 (APU 34) is 
then essentially waiting 1 14 for an "accept", "decline" or 
"screen" command packet. If the "accept" (or "screen") 
packet does not arrive within the predetermined time- 
out period or if a "decline" packet is received, the APU 
34 performs the ring-no-answer process 110 as rf a 
"decline" command packet had been received (and the 
PCIPPN is not deleted). 

Since the subscriber PC can be involved in a com- 
pute intensive communication with the ISP 16. it is pos- 
sible for the platform 22 to use a TCP connect failure 
counter to count the number of failures and only delete 
the PCIPPN when the number of failures exceeds some 
predefined value. 
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When an "accept" packet is received, the APU 34 
begins 116 (See figure 5) digitizing the speech of the 
caller, providing the speech segment packets with the 
PCIPUPN to the NPU 36, which routes the speech 

s packets to the PC 10. At the same time, the NPU 36 
begins accepting subscriber speech packets from the 
PC 10 including the PIPUPN and providing (routing) the 
speech packets to the APU 34, which plays the digitized 
speech of the subscriber to the caller 24. When a hang- 

70 up is initiated 118, such as by the caller hanging up or 
the platform 22 receiving a "disconnect" command 
packet, the APU 34 stops 120 digitizing the callers 
speech segments, stops supplying the packets to the 
NPU 36 and stops converting subscriber speech seg- 

15 rnents into speech output to the caller. The platform 22, 
in the case of a "disconnect" command from the PC 10, 
sends 122 an "acknowledgement" notification to the PC 
10 and, in the case of a hang-up by the caller, sends a 
"disconnect" command to the PC 10. 

20 As previously discussed, if a "screen" command 
packet is received, the APU 34 (see figure 6) records 
and stores a message using the conventional message 
recording process and also sends 132 the speech seg- 
ments in packets to the PC 10 for playing to the sub- 

25 scriber. If an "accept" command is received 114 while 
the call screening process is being performed, the APU 
34 switches to the talk process 116 previously dis- 
cussed. 

Once the exchange of speech packets has been 

30 discontinued, the platform 22 waits for another call 
arrival 104 or for the arrival 124 (See figure 5) of an "off- 
line" command packet. When the "off-line" command, 
which includes the PCIPPN, arrives, the APU 34 
accesses the subscriber database in the CU 32 and 

35 deletes 1 26 the network address of the subscriber. 

On occasion the caller may not be a person but may 
be a machine, such as a facsimile machine. When the 
call is a facsimile call, after the subscriber has decided 
to accept the call and the APU 34 begins digitizing the 

40 input signal, the call monitoring process of the APU 34 
recognizes that the signal is a facsimile "poll" tone 
(CNG). The APU 34 causes the DSP therein to switch to 
the function of a facsimile modern. The APU 34 also 
notifies the subscriber at PC 10 that the call is a facsim- 

45 ile call and drops the network call between the platform 
22 and the PC 10 by sending an appropriate "discon- 
nect" packet. The APU 34 continues to receive the fac- 
simile signal and stores it as a facsimile message in a 
unified mailbox as described in U.S. application serial 

so number 08/743,793. After the message has been 
stored, the subscriber can access the message over the 
network 12 and retrieve it while remaining connected to 
the ISP 16. As an alternative, the APU 34 can digitize 
the facsimile one page at a time and the pages can be 

55 transmitted as "html" pages over network 12 to the PC 
10 browser using the PCIPPN of the browser, and the 
subscriber can then choose to display, save or print the 
pages. 
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The present invention has been described with 
respect to establishing a telephone call over a packet- 
switched network, such as the Internet, however, it is 
possible for the call to be established over other types of 
packet-switched networks, such as an intranet. The 
invention could also be implemented using the types of 
modems that allow simultaneous data and voice trans- 
missions over the same telephone line. The invention 
can also be used with the emerging standards (incorpo- 
rated herein by reference) being developed for the Inter- 
net, such as H.323, H.245 and T120 that allow the call 
to be a videophone call and allow call conferencing, and 
with emerging protocols (incorporated by reference 
herein), such as RSVP which allows the reservation of 
resources for a desired level of service quality, and RTP 
and RTCP. which enhance the timeliness and synchro- 
nization of the packets. 

The present invention has been described with 
respect to the APU 34 receiving a call and playing a 
ringing signal to the caller while the APU 34 queries the 
subscriber. H is also possible, when the platform 22 
receives ANI signalling, that the APU 34 performs the 
look-up and queries the subscriber before answering 
the call, thereby allowing the end office to provide the 
ringing signal to the caller. 

The present invention has also been described with 
respect to using the microphone and speaker of a con- 
ventional multi-media computer. However, it is possible 
to substitute a telephone handset for the microphone 
and speaker. 

Claims 

1 . A system, comprising: 

a packet-switched network; 
a computer coupled to and conducting a ses- 
sion with said network over a telephone line; 
a telephone system transferring a telephone 
call away from the telephone line when the tel- 
ephone line is busy; and 
a call servicing system coupled to said tele- 
phone system and said network, accepting the 
transferred call and establishing a communica- 
tion link with said computer over said network 
with the link carrying the call. 

2. A system as recited in claim 1 , wherein the link is a 
voice communication link established during the 
session. 

3. A system as recited in claim 1 or claim 2, wherein 
said call servicing system stores a message of the 
caller when the computer declines to establish the 
link. 

4. A system as recited in any of the preceding claims, 
wherein said computer sends a network address of 



said computer to said system when the session is 
initiated. 

5. A system as recited in any of the preceding claims, 
5 wherein the call is a single direction call from the 

call servicing system to the computer. 

6. A system as recited in any of the preceding claims, 
wherein said call servicing system performs echo 

10 cancellation. 

7. A system as recited in any of the preceding claims, 
wherein said computer and said call servicing sys- 
tem perform silence detection and do not send 

15 speech packets when silence is detected. 

8. A system, comprising: 

an Internet network; 
20 a computer coupled to and conducting a 

browsing session with said network over a tele- 
phone line; 

a telephone system transferring a telephone 
call away from the telephone line when the tel- 

25 ephone line is busy; and 

a call servicing system coupled to said tele- 
phone system and said network accepting the 
transferred call, informing said computer that 
the call is waiting, establishing a voice commu- 

30 nication packet-switched link with said compu- 

ter over said network using the telephone line 
with the link carrying speech of the call when 
the waiting call is accepted by said computer, 
the voice communication link being established 

35 during the session, said call servicing system 

storing a message of the caller when said com- 
puter declines to establish the link, said compu- 
ter sending a network address of said 
computer to said call servicing system when 

40 the session is initiated, the network address 

being used to establish the link and the session 
continuing over the telephone line during the 
call over the link. 

45 9. A system, comprising: 

a packet-switched network; 
a computer coupled to and conducting a ses- 
sion with said network; 
so a telephone system transferring a telephone 

call away from a telephone line when a called 
telephone of the telephone line does not 
answer; and 

a call servicing system coupled to said tele- 
55 phone system and said network accepting the 

transferred call and establishing a communica- 
tion link with said computer over said network 
with the link carrying the telephone call. 
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10. A method, comprising: 

detecting that a telephone line of a computer 
user is busy in an Internet session; 
establishing a communication link to the com- 
puter over the Internet; and 
conducting a telephone call over the communi- 
cation link during the session. 

11. A method, comprising: 

conducting a telephone call through a compu- 
ter involved in a packet-switched network ses- 
sion during the session. 

12. A method as recited in claim 1 1 , wherein the tele- 
phone call and the session are carried by a same 
telephone line between the computer and the net- 
work. 

13. A method as recited in claim 12, further comprising 
multi-tasking the session and the call with the call 
having a higher priority. 

14. A method as recited in claim 13, further comprising 
assigning call packets a higher priority than session 
packets. 

15. A method, comprising: 

storing a network address of a computer when 
the computer initiates a network session; 
detecting that a telephone line to the computer 
is busy; 

determining that the session is in progress 
when the address is stored; 
establishing a communication link with the 
computer using the address during the ses- 
sion; and 

conducting a telephone call over the link during 
the session. 

16. A method, comprising: 

detecting an arrival of a telephone call while a 
computer is busy in an Internet session; 
establishing a communication link to the com- 
puter over the Internet; and 
conducting the telephone call over the commu- 
nication link during the session. 

17. A system coupled to a packet-switched network 
and a telephone system transferring a telephone 
call away from the telephone line when the tele- 
phone line is busy, said system comprising: 

a computer coupled to and conducting a ses- 
sion with the network over a telephone line; 



and 

a call servicing system coupled to the tele- 
phone system and the network accepting the 
transferred call and establishing a communica- 
5 tion link with said computer over the network 

with the link carrying the call. 

18. A call servicing system coupled to a packet- 
switched network, a telephone system transferring 

10 a telephone call away from a telephone line when 
the telephone line is busy and a computer coupled 
to and conducting a session with the network over 
the telephone line, said call servicing system 
accepting the transferred call and establishing a 

15 communication link with the computer over the net- 
work with the link carrying the call. 

19. A computer, comprising: 

20 a modem connectable to a packet-switched 

network; 

a sound unit capable of inputing and outputing 
speech signals to a user; and 
a browser capable of conducting a telephone 
25 call over a packet-switched network during a 

network browsing session using said modem 
and said sound unit. 

20. A computer program embodied on a computer 
30 readable medium and comprising a process for 

conducting a telephone call through the computer 
involved in a packet-switched network session dur- 
ing the session. 

35 
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